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Abstract 

Research related to teaching climate 
change, system thinking, current reform 
in science education, and the research on 
reform-oriented assessment indicate that 
we need to explore student understanding 
in greater detail instead of only testing 
for an incremental gain in disciplinary 
knowledge. Using open-ended items we 
assessed details in student successes 
and challenges in thinking about cli¬ 
mate change and climate system. Twelve 
teachers of the 7 th and 8 th grades and 457 
students from four schools in a Mid¬ 
western state participated in this study. 
Statistical analysis of student responses 
on the pre- and post-test showed a sig¬ 
nificant (p<.0001) gain in knowledge but 
more importantly, qualitative analysis 
of student responses showed that they 
learned that our climate is changing but 
had constructed a linear connection be¬ 
tween variables such as surface tempera¬ 
ture and drought. The students did not 
develop a connected body of knowledge 
or an understanding of climate as a sys¬ 
tem. Future research needs to focus on 
curriculum development, effective sys¬ 
tem pedagogy, assessment, and teacher 
development in the context of climate 
change as an interlinked system. 

Introduction 

Scientists are unequivocal about the 
impact of climate change on nature and 
living organisms (IPCC, 2013). Yet, 
the public and media appear to believe 
that it is a controversial issue because 
they perceive that scientists are not yet 
convinced of it (Reardon, 2011); even 
some teachers believe it to be a debat¬ 
able issue (Wise, 2010). This scientific 
topic is frequently viewed through the 
lenses of political and business interests 
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and its inclusion in school curriculum 
sometimes becomes a subject of debate 
(Hesteness et al., 2014). On the other 
hand, current reforms in science educa¬ 
tion as described by A Framework for 
K-12 Science Education (NRC, 2012) 
and the Next Generation Science Stan¬ 
dards (NGSS) (Achieve, 2013) recom¬ 
mend that all students from middle 
school onwards should understand the 
causes, effects, and methods of mitigat¬ 
ing climate change. 

There is a large body of research on 
student misconceptions about climate 
change and related concepts (e.g., 
Andersson & Wallin, 2000; McCuin 
et al., 2014; Osterlind, 2005; Rye et al., 
1997; Shepardson et al., 2009); however, 
there are few studies on the teaching 
of the topic. Even less is known about 
what students know in regard to climate 
as a system and how student knowledge 
can inform curriculum development and 
teaching. In the following sections we 
review the research on student miscon¬ 
ceptions, teaching climate change, and 
system thinking. Based on these reviews, 
we developed the research questions that 
framed the current study. 

Findings from Relevant 
Research 

Research on Student Misconceptions 
and Teaching 

Climate change, undoubtedly, is an 
important global issue of our time but there 
are a plethora of misconceptions held by 
students and adults. Many researchers 
have studied students’ understanding and 
beliefs about the greenhouse effect and 
climate change. Due to space limitations, 
we provide only a brief summary of the 
key findings in this area (see Shepardson, 
Niyogi, Choi, & Charusombat, 2009 and 
McCuin et al., 2014 for a detailed sum¬ 
mary of misconceptions about climate 
change). Most of the studies examined 


secondary students’ understanding of 
climate change. Students think pollution 
and the ozone hole cause global warming; 
some middle school students think that 
carbon dioxide causes ozone depletion 
that in turn causes global warming (Rye 
et al., 1997). Cordero and his colleagues 
(2008) found similar ideas among un¬ 
dergraduate students. Other researchers 
found that students believe that green¬ 
house gases constitute a layer or a roof 
that bounces “heat” back to the earth 
(Andersson & Wallin, 2000; Shepardson 
et al., 2009; Osterlind, 2005). Students 
also think of global warming as a change 
in temperature and mostly ignore its 
relationship to precipitation (Shepardson 
et al., 2009; Kilinc, Stanisstreet, & Boyes, 
2008). They do not consider the var¬ 
ied effects of global warming at differ¬ 
ent geographic locations in the United 
States or the world (Boyes & Stanis¬ 
street 1993). Only a few studies (Gowda, 
Fox, & Magelky 1997; Pruneau et al., 
2003) have explored student understand¬ 
ing of the distinction between weather 
and climate, even though this concept 
is fundamental to understanding climate 
change. These studies showed that stu¬ 
dents fail to understand climate as a long 
term (over decades) average of meteorol¬ 
ogical patterns, which implies that these 
students are unlikely to understand that 
changes in climate happen over decades, 
that climate change cannot be directly 
experienced as weather and that mitiga¬ 
tion would take a long time before its 
benefits could be observed. 

Research on Teaching Climate 
Change 

It is essential that students understand 
climate change and be able to make in¬ 
formed decisions about this issue and 
its impact on society, both locally and 
globally. Research on teaching climate 
change, curricular development, teacher 
professional development, and student 
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learning is beginning to emerge. Several 
studies report student knowledge gain 
as a result of teaching specific concepts 
regarding climate change and address¬ 
ing common misconceptions. McCuin 
et al. (2014) compared the pre-, post-, 
and delayed (by two weeks) post-test 
scores of 197 students in an introductory 
earth science course who were randomly 
assigned to a traditional reading-based 
instruction (TRI) or a misconception 
reading-based instruction (MRI). Both 
groups read common materials that fo¬ 
cused on discrete accepted/scientific 
concepts about the greenhouse effect 
and climate change. In addition, the 
TRI group (n=83) read materials that 
consisted of scientific concepts and the 
MRI group (n= 114) read materials that 
addressed common student misconcep¬ 
tions. The test for this study consisted 
of 64 true/false items. The students in 
TRI and MRI groups gained significant 
knowledge but MRI students retained 
more knowledge than the TRI group. 
The authors concluded that address¬ 
ing the misconceptions via reading was 
more effective for long-term retention of 
climate change and related concepts. 

Another group ofresearchers (DeWaters 
et ah, 2014) report a study in which mid¬ 
dle and high school students were taught 
using project-based climate change in¬ 
structional modules. Comparison of mid¬ 
dle school (MS) and high school (HS) 
student (MS: n= 227 and HS: n=200) 
scores on a climate literacy question¬ 
naire consisting of cognitive and behav¬ 
ioral subscales showed significant gain 
in both areas after they participated 
in the modules. However, the authors 
also pointed out that the mean post¬ 
questionnaire scores were low for both 
MS and HS students, indicating only a 
small impact from the modules used in 
the study. The lack of impact suggests 
that the curriculum and instruction both 
need further investigation to determine 
their effectiveness. 

McNeill and Vaughn (2012) examined 
how students’ attending an urban high 
school made positive gains in their un¬ 
derstanding, beliefs and actions about 
climate change. They used a written test 
consisting of 16 multiple-choice and 


three free-response items and interviews 
as pre- and post-measures to determine 
the impact of two units on urban ecol¬ 
ogy and climate change. They collected 
written data from 75 students and in¬ 
terviewed 22 students. Students gained 
significant knowledge about the green¬ 
house effect, warming of the climate, 
and human impact on climate. They also 
reported taking personal actions to con¬ 
serve energy usage. 

All of these studies report significant 
gains in student knowledge of climate 
change and the greenhouse effect. They 
also report an increase in student interest 
in mitigation of the adverse effects of cli¬ 
mate change or their active engagement 
in mitigation efforts. These studies sug¬ 
gest pathways to educate students about 
climate change but they do not provide 
any information about student under¬ 
standing of the climate as a system, its 
variability, and the feedback loops in the 
interactions of the components of the sys¬ 
tem. The multiple-choice questions used 
by most of these studies resulted in identi¬ 
fying which pieces of knowledge students 
have acquired but they provided little in¬ 
sight into how students connect disparate 
components of knowledge into a coherent 
understanding of climate as a system. 

The nature of the tests used to assess 
students’ knowledge is crucial, particu¬ 
larly when we are targeting a relatively 
new domain such as climate change. In 
addition, we wanted to know about how 
students used evidence-based reason¬ 
ing - a practice of science prioritized by 
Frameworks (NRC, 2012) and NGSS 
(Achieve, 2013). Students’ knowledge 
of science content can be tested with 
multiple-choice items but their exper¬ 
tise in using a well-connected body of 
content to reason and explain their ob¬ 
servations may require other modes of 
investigation. Researchers, who aim to 
discover what students learned as well as 
their difficulties need to use open-ended 
items (Gotwals & Songer, 2013; Walker & 
Sampson, 2013). 

Taken together, the research on teach¬ 
ing climate change, current reform in 
science education, and the research on 
reform-oriented assessment indicate that 
we need to explore student understanding 


in greater detail than in previous stud¬ 
ies. Furthermore, in order to develop a 
connected body of knowledge about cli¬ 
mate change students need to have some 
understanding, however rudimentary it 
may be, about the climate system and we 
need to know how students think about 
complex systems such as climate. 

Research on System Thinking 

Climate is a naturally complex system 
and system thinking is necessary to under¬ 
stand its variations, causes, and effects. 
Researchers have been studying system 
thinking in many contexts. For example, 
studies have been carried out on evolu¬ 
tionary processes (Centola, Wilensky, & 
McKenzie, 2000), the aquarium system, 
(Hmelo-Silver, Marathe, & Liu, 2007); 
social systems (Booth-Sweeney, 2000), 
thehydrologicsystem(Ben-Zvi-Assaraf& 
Orion, 2010), the dynamic and cycli¬ 
cal nature of the Earth’s crust, and the 
rate and direction of chemical reac¬ 
tions (Stieff & Wilensky, 2003). Based 
on the research on system thinking, and 
their own research on student thinking 
in the context of water cycles, Ben-Zvi- 
Assaraf and Orion, (2010) delineated a 
system thinking hierarchical model. This 
model projects that, at the simplest level, 
students will be able to analyze the com¬ 
ponents and processes within the system. 
Students at the next higher level will be 
able to synthesize the relationships in 
the system; they will be able to identify 
the relationships among the components 
and their dynamics to organize the com¬ 
ponents within a framework of relation¬ 
ships, and to identify the cyclical nature 
of the system components. Students at 
the highest level will be able to gener¬ 
alize their understanding of the system 
they are learning about, understand the 
dimensions of the system, think tempo¬ 
rally, and make predictions. 

The studies discussed above, however, 
do not clearly address the teachers’ 
role in incorporating systems think¬ 
ing in classrooms. Some researchers 
(Jacobson & Wilensky, 2006; Hmelo-Silver 
et al., 2007) point out that system think¬ 
ing is essential for deeper understand¬ 
ing of many topics in science, yet it is 
not a regular facet of teaching. They 
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recommend more research on system 
thinking pedagogy and ways to incorpo¬ 
rate it in the teaching of science. 

Based on our previous work on cli¬ 
mate change education, we had proposed 
a visual representation of the climate 
system and a conceptual framework 
for teaching about the climate system 
(Shepardson, Niyogi, Roychoudhury, & 
Hirsch, 2012). The framework focused 
on the climate system components - the 
Sun, atmosphere, oceans, land, vegeta¬ 
tion, and ice - and the absorption, emis¬ 
sion, and reflection of the Sun’s and 
other forms of energy by the compo¬ 
nents of the system. The other major foci 
were the difference between weather 
and climate, the Earth’s energy budget, 
feedback loops, variations in the com¬ 
ponents due to natural (e.g., volcano) or 
anthropogenic (e.g., land use) and en¬ 
ergy transfer between the components 
of the system. The framework consisted 
of three conceptual levels describing in¬ 
creasing degrees of understanding for 
each of the topics listed. To translate 
this framework into specific curriculum 
and pedagogical goals, resources, les¬ 
sons, and performance expectations as 
described by Achieve (2013), requires 
that we gather more details about student 
successes and challenges in learning 
about climate change. To this end, we 
constructed the following two research 
questions to frame our study: 

Research Question 

i. Is there a significant difference be¬ 
tween middle school student knowledge 
of climate change before and after in¬ 
struction as captured by free-response 
questions? 

ii. What are the educational implica¬ 
tions of these findings about student 
knowledge of climate change? 

The Study 

Method 

This is exploratory research aimed at 
finding patterns in student responses to 
open-ended items of a content knowl¬ 
edge test relevant to the topics taught 
by middle school teachers. We used 
written data instead of interviewing a 


few students so that we could look for 
patterns in the responses of a larger 
number of students. Twelve teachers of 
the 7 th and 8 th grades from four schools 
in a Midwestern state in the USA vol¬ 
unteered to teach climate change and 
collaborated with the researchers in 
this study. All teachers were licensed 
to teach in middle schools and six of 
them had advanced degrees in biology, 
earth science or environmental science. 
Four had at least a bachelor’s degree in 
a science domain while the other three 
had taken science courses required for 
a middle school teaching license. Thus, 
most of the teachers were expected to be 
well versed in system thinking in their 
own domains and in the importance of 
a connected body of knowledge. These 
teachers worked with the researchers and 
developed curricula suitable for their stu¬ 
dents, field tested the lessons and modi¬ 
fied them where they deemed necessary. 

Over a 9-11 week period, the teachers 
taught the following topics: a. Earth’s 
Energy Budget; b. Differential Heating 
of the Earth’s Surface; c. Weather and 
Climate (including Climate Variability); 
d. Greenhouse Effect; e. Carbon Cycle; 
and f. Global Warming and Climate 
Change Impacts. Each topic consisted 
of multiple lessons that used a variety of 
materials such as hands-on experiments, 
readings, physical models, visuals, sim¬ 
ulations, and extant data on climate fac¬ 
tors. Interactions among the components 
of the climate system - the Sun, the Earth 
(ocean, land, and atmosphere), and hu¬ 
man impact undergirded the curriculum. 
Four hundred and fifty-seven students 
from one urban and three rural schools 
participated in this study. 

Instrument and Data Analysis 

The research team, consisting of a sci¬ 
ence educator, an earth scientist, a physi¬ 
cist, and a climate scientist developed the 
content test Understanding Climate and 
Climate Change (UCCC) and the partic¬ 
ipating teachers reviewed and provided 
feedback on the questions, and helped 
finalize the test. This collaborative pro¬ 
cess of developing the test established 
its content and face validity. The test 


consisted of 16 questions, some of which 
had multiple sub-parts. Some questions 
assessed student knowledge of essential 
facts (e.g., identifying greenhouse gases) 
while others assessed student reasoning 
and explanations. The test was adminis¬ 
tered before and after the teachers taught 
the climate change topics. 

Four members of the research team 
independently conducted a content anal¬ 
ysis of written responses to the ques¬ 
tions to identify the patterns in student 
responses (Erickson, 1986; Patton, 2002). 
After coding a set of 15 tests in the first 
round the researchers compared the 
codes and arrived at a consensus in their 
interpretations and revised the coding 
scheme accordingly. This allowed an 
initial triangulation, reduced the subjec¬ 
tivity, and increased the validity of our 
interpretation of the student responses 
(Patton, 2002; Corbin & Strauss, 2008). 
This process was used iteratively two 
more times with additional tests and 
89% - 91% agreement was reached as 
a result of this process. The final cod¬ 
ing scheme was vetted by the climate 
scientist and the physicist for conceptual 
correctness and then used by the re¬ 
searchers to code the entire written data 
set. The test assessed three broad topics: 
greenhouse effect, weather and climate, 
and climate change. Table 1 shows ex¬ 
amples of questions, student responses, 
and the scores assigned to the responses. 

To find out the overall changes in stu¬ 
dent knowledge of climate change and 
related concepts, we conducted paired 
t-tests of the total scores obtained by 
individual students. We also conducted 
t-tests for each of the three clusters 
mentioned: Greenhouse Effect (GHE), 
Weather and Climate (WCL), and a 
Climate Change (CLChange). The total 
number of questions was different for each 
cluster. GHE consisted of 7 questions (1 
to 7), WCL consisted of 5 questions (8 to 
12) and CLChange of 6 questions (13 
to 16 which has four subparts). Because 
the questions were open ended and this 
study is exploratory in nature we did 
not assign a predetermined score to any 
item; thus the score for each question 
varied according to the details the stu¬ 
dents provided. Since we are exploring 
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Table 1, Exemplars of codes with scores 

Question 

Student response/score 

Rationale 

Exemplars from the greenhouse effect cluster 

2. What gases make up the Earth’s atmosphere? 

0xygen/1 

Each correct answer received one point; 


l\litrogen/1 

knowledge of proportional makeup of 


Hydrogen/0 

Carbon dioxide/1 

the atmosphere was not expected. 

3. Which of the gases you listed above are 

Carbon dioxide/1 

Each correct answer received one point. 

the greenhouse gases? 

0xygen/0 

Nitrogen/0 

Water vapor/1 

Air/0 


4. Why are they called greenhouse gases? 

Absorb the Sun’s rays/ energy/Sun/1 

Any response that showed that a student 


Because they react with the Sun and 

understands that greenhouse gases absorb 


heat the Earth/1 

some form of radiation (infra-red or even 


They come from greenhouses or 

if students called it heat or light) received 


help plants/0 

1 point. 

Weather and climate cluster 

Jack and Diane were trying to decide if the 

N/A 

N/A 

following newspaper stories were talking 
about weather or climate. 



A. Indiana had more snow last winter than normal. 
Over 20 inches of snow fell during the winter. 

B. Indiana’s precipitation has been increasing every 



year since the 1970’s. Today, there is 5 inches 
more precipitation than in 1970. 



C. Indiana had one of the coldest springs 



in history; temperatures were 5 degrees 
colder than normal. 



D. Indiana’s average spring temperature is 



unchanged since the 1970’s. This spring’s 
temperature averaged 45 degrees compared 
to 44 degrees in 1970. 



10. Which of the above stories do you think 

A./0 

The scoring was based student selection 

is about climate? (There can be 

B./1 

of the correct choice (understanding 

more than one)* 

c./o 

of the timescale). 


D./1 


11. Explain your answer choice for 

Because they talk about climate/1 

Understand that climate involves a longer time; 

question number 10. 

Climate is a long time/1 

Climate involves average conditions over 


Climate is average over 30 years/2 

decades - this is a more sophisticated 


Talks about temperature or rain or snow/0 

understanding than just longer time and 
therefore received 2 points. 

Climate change cluster exemplars 

16. Some scientists think that the Earth’s 

N/A 

N/A 

climate is getting warmer, 
a. If these scientists are correct what might 

Ocean will warm causing its level to rise 

For correct inference about ocean temperature 

happen to the oceans? Explain why you 

because of melting polar ice/3 

trend (1 point), water level (1 point), and 

think that would happen?** 

Oceans will warm causing it to dry out or to 

about other causes such as melting of 


evaporate more/0 

polar ice (1 point). 

* There were similar questions about weather 



** There were similar questions about plants and animals as well as people and society 


the changes in student knowledge and 

the clusters. The data were analyzed us- 

Therefore, to determine the effect of 

thoughts, the scoring procedure was 

ing SAS 9.4, and the results are provided 

teaching of each topic, the effect size 

deemed appropriate for this study. All the 

in Table 2. 

was also calculated. The effect size 

tests were conducted at the 95% confi- 

Because of the large sample size, 

compares the difference of the means 

dence interval. The t-test results indicated 

it was probable that the difference 

to the pooled standard deviation (i.e.. 

that there was a significant difference 

between the pre-and the post-test 

the root mean square of the individual 

between pre- and post-test scores for all 

score would appear to be significant. 

standard deviations). The effect sizes 
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Table 2. t values with an asterisk had p<0.0001 


cluster 

n 

variable 

mean 

std dev 

effect size 

t(456) 

GHE 

457 

pre 

7.71 

4.15 

0.92 

18.06* 



post 

12.27 

5.16 



WCL 

457 

pre 

2.88 

2.58 

0.69 

11.92* 



post 

4.88 

3.22 



CLChange 

457 

pre 

6.87 

2.82 

0.32 

5.95* 



post 

7.77 

2.83 



Total 

457 

pre 

17.45 

6.94 

0.92 

19.10* 



post 

24.92 

9.19 




indicate that the CLChange cluster had 
much smaller improvement in scores 
compared to the other two clusters. 

For sample sizes greater than 30, a 
normality test need not be carried out 
(Ghasemi 2012). Nevertheless, we con¬ 
ducted one for completeness of the anal¬ 
ysis. The Shapiro-Wilk results indicated 
that the distributions were not normal 
at the 95% confidence level. Therefore, 
as a check, we conducted the Wilcoxon 
signed-rank test, a non-parametric test, 
which is used instead of the t-test in 
situations of non-normal distributions. 
The results agree with the t-tests, that is, 
there was significant difference between 
the pre- and post-tests for all the clusters. 

Findings 

Students gained significant (p<.0001) 
knowledge about all the topics related 
to climate change that were tested with 
a large effect size (.92), however, their 
gains about different clusters of concepts 
varied (Table 2). Their knowledge gain 
was the highest in the GHE cluster and it 
also had the highest effect size. We dis¬ 
cuss student responses from the post-tests 
because these tell us student knowledge, 
claims, and explanations after instruction 
and hope that these point to the directions 
that future research may take. 

Using a previously developed model 
from student responses (Shepardson et al., 
2009) we found that 47% (n=215) of the 
students believed GHE was the same as a 
greenhouse for growing plants (an incor¬ 
rect idea) and 25.7% (n= 117) thought that 
GHE means there are some greenhouse 
gases in the atmosphere with no men¬ 
tion or explanation of the heating mecha¬ 
nism. There was a major shift in student 


understanding of the GHE as reflected 
by their responses on the post-test. Only 
15.3% (n=70) students thought the GHE 
to be the same as a greenhouse, whereas, 
35.6% (n=163) thought that greenhouse 
gases “trap” the sun’s rays, heating the 
Earth and another 34.2% (n=156) thought 
that the Sun’s rays are “bounced” or re¬ 
flected back and forth between the Earth 
surface and greenhouse gases (the best 
model held by these middles school 
students). However, even this model is 
quite rudimentary and does not reflect 
any understanding of the climate system 
(Shepardson et al., 2012). 

Student knowledge gain about weather 
and climate was also significant, with 
a moderate effect size (.69). Their un¬ 
derstanding of the difference between 
weather and climate improved after in¬ 
struction. They were able to distinguish 
between the two in terms of timescale 
from the statements provided (see Table 
1: Weather and Climate cluster exem¬ 
plar). Most of the students understood 
that climate is a pattern that exists over 
a long time period and they mentioned 
decades as the scale in their explanations. 
Likewise, they knew that weather is what 
happens over a short time period, now as 
opposed to over a year or a few years but 
not decades. On the post-test, most of the 
students (62%; n=283) listed geographic 
features, such as the distance of a loca¬ 
tion from the equator and sunlight, on the 
post-test as the reasons for variations in 
climate at different locations on the Earth. 
Many students (over 80%; n=366) also 
mentioned weather conditions (perhaps 
implying that climate is the average of 
weather) and temperature as determiners 
of the climate of a location. Only 24% 


(n=110) of the students mentioned prox¬ 
imity to oceans as a factor affecting the 
climate of location. Irrespective of the 
factors that the students mentioned, they 
did not explain how these features affected 
the Earth’s climate in different locations, 
how these factors interacted, or how the 
interactions influenced the climate. 

It is perhaps not surprising that the stu¬ 
dent knowledge gain was the lowest for 
the CLChange cluster, given the rudi¬ 
mentary nature of their knowledge about 
weather and climate. Even though student 
knowledge of climate change improved 
significantly after instruction, the effect 
size for this cluster is small - only .32. 
A majority of the students (83%; n=379) 
knew that the Earth’s climate is getting 
warmer; however, fewer than half of the 
students (39%; n= 178) provided any de¬ 
tail about the effects of climate change 
such as a reduction of the polar ice sheet 
and its possible consequences. None of 
the students showed any awareness of the 
related feedback loop between ice, ocean, 
and the atmosphere. A small fraction of 
the students (17%; n=78) mentioned hu¬ 
man activities and increased carbon diox¬ 
ide in the atmosphere as the reason for the 
elevated temperature. 

In response to the questions about 
the effects of global warming on ocean, 
weather, plants, animals, people, and 
society, students mentioned that ocean 
levels will rise, weather will get warmer 
leading to more evaporation and drought 
or longer summers. Students thought 
that plants and animals will die and if 
they provided any reason then it was the 
increased temperature or heat. A few 
(less than 10%; n=42) mentioned an 
interaction between plants and animals 
(the food chain)—the animals will die 
because plants will die. A few other stu¬ 
dents mentioned that some plants would 
thrive in the warmer climate as well as 
some animals because they would have 
more food due to an increase in vegeta¬ 
tion. Student responses about the impact 
of a warming climate on people and so¬ 
ciety were very similar to the ones on 
plants and animals. That is, people will 
die due to heat and lack of water or food 
or due to illness caused by warming (of 
the Earth). A few students thought that 
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technological advances would provide 
solutions to global warming. In general, 
most students wrote only one effect of a 
warming of the climate and provided no 
reason for the effect they claimed would 
happen. They appeared to not be famil¬ 
iar with the scientific practice of provid¬ 
ing evidence or theoretical support for a 
claim. 

Implications 

Our work was grounded in the lit¬ 
erature on climate and climate change 
education and the findings from student 
pre-test data, which essentially corrobo¬ 
rated the trends in the relevant litera¬ 
ture. To complement the findings from 
that extant research on teaching climate 
change, we aimed at finding out details 
about middle school student knowledge 
in this domain, using open-ended ques¬ 
tions. We posit that understanding of 
climate change should also include an 
understanding of the climate system. 
However, given the emerging nature of 
curriculum and instruction in this area, 
not much is known about student system 
thinking in this context. We hope that our 
findings would shed some light on stu¬ 
dent successes and challenges in learn¬ 
ing about climate change and in thinking 
about the climate system and inform fu¬ 
ture research on climate change teaching 
and learning. 

As in other studies (DeWaters, et al., 
2014; Lee, et al., 2007; McCuin et al., 
2014; McNeill & Vaughn, 2012), these 
middle school students gained signifi¬ 
cant knowledge about GHE. Additionally, 
they also gained knowledge about the 
difference between weather and climate 
and climate change, a fundamental con¬ 
cept that the other researchers did not ad¬ 
dress. In fact, others have noted that the 
students in their studies did not under¬ 
stand the timescale issue about climate 
change. The understanding of the dif¬ 
ference between weather and climate is 
the foundation for understanding climate 
variability and change, particularly, the 
timescale underlying the change. With 
this basic idea, students may be able to 
understand that as it takes decades to 
establish convincing records of change 
in the Earth’s climate and its impact, it 


might take a long time to mitigate these 
effects. Thus, there is a need for long¬ 
term policies and actions. They are likely 
to become aware of the importance and 
challenges of mitigation and participate 
in taking informed actions in their per¬ 
sonal lives as members of society. This 
understanding may help them decide 
about what kind of light bulb they select 
or what kind of agricultural practice they 
adopt or whether they vote for increased 
use of renewable energy and similar 
energy-climate issues. Other researchers 
have noted the development of favorable 
attitudes toward mitigation and taking 
adaptive action in students after learning 
about climate change. Although we did 
not assess student attitudes, we interpret 
from student responses that being more 
informed will help them make better 
decisions. 

Students in our study also developed 
a basic understanding of climate change 
as a warming of the Earth, as noted by 
other researchers (DeWaters et al., 2014; 
McCuin et al., 2014; McNeill et al., 2012). 
However, this understanding was quite 
superficial as the students showed only 
a linear view of climate change, in the 
sense that the warming will have a dry¬ 
ing effect (e.g., drought) and people and 
animals will die or have to move to other 
locations. This rudimentary knowledge 
nonetheless forms an essential founda¬ 
tion on which more sophisticated un¬ 
derstanding can be built later. This also 
points to a possible direction of future 
curriculum development and teaching. 

Other studies (DeWaters et al., 2014; 
McCuin et al., 2014; McNeill & Vaughn, 
2012) have tested student knowledge 
gain using multiple choice questions and 
have shown that students learned sub¬ 
sets of facts about climate change, but 
those findings did not inform us about 
students’ overall thinking about climate 
change. Even the interview data col¬ 
lected by McNeill and Vaughn did not 
provide any information about student 
knowledge of the climate system. In¬ 
deed, by asking open-ended questions, 
we found that students did not construct 
a richly connected body of knowledge 
about GHE and climate change. They 
saw climate change to be the same as 


global warming. They also saw effects 
of climate change in terms of simple 
and linear relationships (e.g.„ warmer 
average temperature would melt ice or 
evaporate water) which indicated that 
they did not think of climate as a sys¬ 
tem with many components, and they 
did not show any understanding of in¬ 
teractions among the components. An¬ 
other major limitation in their thinking 
was a lack of awareness of the interac¬ 
tions and the non-linear feedback loops 
that research on system thinking holds 
as fundamental to understanding the 
Earth’s climate (Shepardson et al., 2012; 
Ben-Zvi-Assaraf et al., 2009). It was evi¬ 
dent that students did not consider dif¬ 
ferential effects of global warming at 
different locations on the Earth, that an 
increase in the average temperature of 
the Earth does not mean a higher temper¬ 
ature everywhere. Also, they envisioned 
a hotter earth becoming drier and did not 
consider that warmer bodies of water 
can result in increased precipitation due 
to evaporation and condensation. These 
students’ linear and incomplete thinking 
was evident in their description of polar 
ice sheet melting. They did not consider 
the consequences of ice melting, such as 
reduction in albedo and an increase in 
the "heat” absorbed by the ocean that, 
in turn, would impact the Earth’s energy 
budget and have varied effects at differ¬ 
ent geographic regions. Furthermore, 
these students primarily thought about 
drought as an effect of global warming 
and did not mention the effect on ocean- 
level rising or the impact of climate 
change on increasing severe storms. Put 
another way, the students did not show 
an awareness of the multitudes of evi¬ 
dence of climate change that could show 
some awareness of the climate as a sys¬ 
tem. Although, from our current study, 
we cannot draw conclusions about the 
reasons for this kind of simplistic linear 
view of the Earth’s climate and changes, 
we can consider the implications of such 
piecemeal knowledge gathering and lin¬ 
ear thinking for future research in this 
domain. 

In this section we will first describe our 
inferences about teaching and learning 
and then their implications. There could 


78 


Science Educator 




be many reasons why students responded 
the way they did. Discussion within the 
study team, including the teachers, led 
us to infer several possible reasons for 
student performances. First, the teachers 
may have taught a more complex view of 
climate change with an implicit reference 
to the underlying system but students 
only wrote about global warming because 
that is what they have heard about in 
the media and remembered. Second, the 
teachers may not have taught much more 
about climate change than a general view 
of global warming; they may have used 
only linear examples such as the drying 
effect of climate change. Third, students 
generally take multiple-choice tests and 
quizzes and are not accustomed to writ¬ 
ing detailed explanations. Consequently, 
they could have assumed that writing 
down a short answer or one cause or one 
effect would suffice. Fourth, our expecta¬ 
tion was that students would write com¬ 
plete explanations consisting of claims 
supported by evidence to the open-ended 
items, yet many studies have shown that 
the scientific practice of evidence-based 
reasoning has to be explicitly taught in 
school and even in college-level science 
courses (Osborne et al, 2004; Walker & 
Sampson, 2014). Fifth, the teachers may 
have taught many concepts regarding cli¬ 
mate change, but did not explicitly engage 
students in connecting those together to 
promote a system view. As a result, stu¬ 
dents wrote only the most basic ideas as 
their responses. Sixth, even though more 
than half of the teachers had extensive 
knowledge of science (a bachelors degree 
in a science discipline) and five of them 
have advanced degrees, and presumably 
should have been quite familiar with sys¬ 
tem thinking, their knowledge did not re¬ 
sult in effective pedagogy. The last is of 
small surprise as it is well known among 
educators that deep content knowledge 
does not generate effective pedagogical 
strategies. Although there can be other 
reasons for the students’ simplistic an¬ 
swers and they could be addressed in 
other ways, we think that the reasons we 
inferred here have implications for curric¬ 
ulum development, teacher professional 
development, and instruction of content 
and the practice of science. 


At the outset, we want to underscore 
that we agree with researchers (e.g., 
Sampson & Blanchard, 2012) who point 
out that teaching and assessment in most 
science courses - even at the undergrad¬ 
uate level - aim at acquisition of knowl¬ 
edge and this is the model teachers tend 
to embrace in their teaching. As a conse¬ 
quence, their students may not learn to 
write answers with explanations - some¬ 
thing that we had expected to see in this 
study. Our study shows that students need 
to learn about the climate system, rather 
than facts about the changes and their 
causes. Understanding climate change 
involves understanding complicated 
evidence from various sources such as 
ocean, ice, atmosphere, land, human ac¬ 
tivities and the interactions among them 
(NASA, 2015). Some researchers (B en-Zvi- 
Assaraf & Orion, 2010; Jacobson & 
Wilensky, 2006; Hmelo-Silver et al., 
2007) recommend more research on 
system thinking pedagogy and the ways 
to incorporate it into the teaching of 
science. This may be the crux of the is¬ 
sue. Even teachers who have extensive 
knowledge of systems in their domains 
of science may not have the pedagogi¬ 
cal resources to utilize this knowledge 
in teaching. Future research can begin 
with the conceptual framework for the 
various levels of understanding of the 
climate system (Shepardson et al., 2012) 
and translating it into lessons that pro¬ 
mote system thinking appropriate for 
each level. Furthermore, research needs 
to explore what system thinking peda¬ 
gogy might look like. What strategies 
should teachers adopt to promote stu¬ 
dent development of a connected body 
of knowledge about climate change? In 
what sequence should the components 
of the climate system - the Sun, atmo¬ 
sphere, oceans, land, and vegetation - be 
taught and in what sequence should the 
interactions among these components be 
taught? Given that teaching progresses 
linearly, at which point should the con¬ 
nections among the concepts be estab¬ 
lished and what pedagogical strategies 
should be tried in this regard? 

Based on our findings and the litera¬ 
ture we reviewed, we postulate that sys¬ 
tem thinking may need to come in the 


fore in curricula and in teaching about 
climate change. Future research needs 
to determine where in a curriculum the 
concept of climate as a system should 
be introduced, what the level of system 
thinking at which researchers would 
aim should be, at which points the un¬ 
derstanding of climate system should be 
modified in light of new concepts, and 
how student understanding of climate 
system should be assessed. For example, 
we (the researchers and the teachers) 
conceptualized the lessons on Earth’s 
energy budget with the flow of energy 
through the climate system as the core 
idea and flow of matter through the sys¬ 
tem in the carbon cycle. However, stu¬ 
dents did not connect the concepts, nor 
did they demonstrate any understanding 
of climate as a system, implying that 
future research needs to focus on how 
teaching, learning, and assessment can 
help students develop a connected body 
of concepts and think about climate as a 
system. 

In summary, we think that future re¬ 
search needs to explore what integra¬ 
tion of system thinking into teaching of 
climate change, beginning at the middle 
school level, would look like. Research 
also needs to focus on curriculum de¬ 
velopment, effective system pedagogy, 
assessment, and teacher development in 
the context of climate change. 
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